Recursive eigendecomposition via autoregressive analysis and ago-antagonistic regularization
نویسنده
چکیده
A new recursive eigendecomposition algorithm of Complex Hermitian Tœplitz matrices is studied. Based on Trench’s inversion of Tœplitz matrices from their autoregressive analysis, we have developed a fast recursive iterative algorithm that takes into account the rank-one modification of successive order Toeplitz matrices. To speed up the computational time and to increase numerical stability of illconditioned eigendecomposition in case of very short data records analysis, we have extended this method by introducing an ago-antagonistic regularized reflection coefficient via Levinson equation. We provide a geometrical interpretation of this new recursive eigendecomposition. 2. PREAMBLE Let us remind you that Levinson algorithm provides Cholesky factorization of the inverse Tœplitz matrix. Rankone modification approach leads to the Gohberg-Semencul formula which is an integrated version of Trench algorithm [5]. Trench algorithm induces an order recursive structure of the inverse Tœplitz matrix. We propose to exploit this existing structure to achieve a fast and robust eigendecomposition. First, we obtain eigenvalues by finding the roots of an autoregressive parameters-based function [2]. At each order, a number of independent structurally identical nonlinear problems is solved in parallel. Derivative of this intermediate function is geometrically interpreted. In a second step, via Levinson equation, reflection coefficient i s used to decrease computational complexity and increase stability by an ago-antagonistic regularization [1][2]. Agoantagonism [6], conceived as Minimum Free Enthalpy concept in a thermodynamic analogy approach, extends regularization method and avoids over-regularization problems. Among research in the area of recursive eigenspace decomposition, other algorithms have been proposed taking advantage of direct Tœplitz matrix structure, like RISE [3][4], but they are not very well adapted to very short data records analysis. 3. RECURSIVE EIGENDECOMPOSITION VIA AUTOREGRESSIVE ANALYSIS 3.1 Yule-Walker and Levinson Equation Autoregressive analysis problem is solved by Yule-Walker equation. Order recursive structure of Tœplitz correlation matrix provides the recursive Levinson equation :
منابع مشابه
M 4 S a Model - Based Pel - Recursive Motion Estimation Algorithm
In this paper, a model-based approach to pel-recursive motion estimation is presented. The derivation of the algorithm is similar to the Wiener-based pel-recursive motion estimation algorithm. However, the proposed algorithm utilizes the spatiotemporal correlations in an image sequence by considering an autoregressive model for the motion compensated frames. Therefore, depending on the support ...
متن کاملRecursive complex BSS via generalized eigendecomposition and application in image rejection for BPSK
Under the assumptions of non-Gaussian, non-stationary, or non-white independent sources, linear blind source separation can be formulated as generalized eigenvalue decomposition. Here we provide an elegant method of doing this on-line, instead of waiting for a sufficiently large batch of data. This is done through a recursive generalized eigendecomposition algorithm that tracks the optimal solu...
متن کاملRecursive Generalized Eigendecomposition for Independent Component Analysis
Independent component analysis is an important statistical tool in machine learning, pattern recognition, and signal processing. Most of these applications require on-line learning algorithms. Current on-line ICA algorithms use the stochastic gradient concept, drawbacks of which include difficulties in selecting the step size and generating suboptimal estimates. In this paper a recursive genera...
متن کاملA dynamic regularized radial basis function network for nonlinear, nonstationary time series prediction
In this paper, constructive approximation theorems are given which show that under certain conditions, the standard Nadaraya-Watson regression estimate (NWRE) can be considered a specially regularized form of radial basis function networks (RBFN’s). From this and another related result, we deduce that regularized RBFN’s are m.s. consistent, like the NWRE for the one-step-ahead prediction of Mar...
متن کاملTopology Selection in Graphical Models of Autoregressive Processes
An algorithm is presented for topology selection in graphical models of autoregressive Gaussian time series. The graph topology of the model represents the sparsity pattern of the inverse spectrum of the time series and characterizes conditional independence relations between the variables. The method proposed in the paper is based on an l1-type nonsmooth regularization of the conditional maxim...
متن کامل